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Abstract 

This article presents a method to automatically de¬ 
tect and classify climbing activities using inertial 
measurement units (IMUs) attached to the wrists, 
feet and pelvis of the climber. The IMUs record limb 
acceleration and angular velocity. Detection requires 
a learning phase with manual annotation to construct 
the statistical models used in the cusum algorithm. 
Full-body activity is then classified based on the de¬ 
tection of each IMU. 

1 Introduction 

The sport of rock climbing requires the use of both 
upper and lower limbs, as climbers reach and grasp 
holds and use their feet to climb the rock surface. 
Yet rock climbing encompasses more than continuous 
upward body movement, because more or less static 
positions are also crucial for exploring and grasping 
surface holds mm, posture regulation mmmm, 
arm release and resting [8] , and finding routes Ellin]. 

The time spent in exploration and posture regu¬ 
lation as opposed to ascending, or more broadly the 
time spent immobile as opposed to in motion, can 
be analysed by quantifying the durations when the 
pelvis is and is not in motion [H][8][12][13] . In [TT] . 
it was noted that advanced climbers spent 63% of a 
climb immobile and 37% in actual ascending. 

As previously noted, periods of immobility may not 
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represent only inappropriate stops, but rather could 
reflect active resting [8]. For example, in na, expert 
climbers were shown to spend a greater proportion 
of their climbing time in static states and more of 
the static time actively resting (i.e. limb shaking), 
compared with climbers of intermediate skill. 

However, a point of difference with mm is that 
in HU the variability in limb behaviour was asso¬ 
ciated with exploration or a more functional use of 
climbing wall properties. This suggests that during 
stops climbers may exhibit behaviours that are dedi¬ 
cated to more than managing fatigue. 

Ascending requires skills in route finding, which 
reveals the ability of climbers to interpret the ever- 
changing structure of the climbing wall design mm- 
Route finding is a critical climbing skill that can be 
identified by differentiating exploratory movements 
and performatory movements [2]. In [2], a distinc¬ 
tion between exploratory and performatory move¬ 
ments was made according to whether a potential 
hold on a climbing wall was touched, irregardless of 
whether it was used as a support. For example, the 
authors of [3] reported that skilled climbers tended to 
touch fewer than three surface holds before grasping 
the functional one. 

Clearly, an excessive duration spent immobile for 
route finding, hold exploration or posture regulation 
is likely to compromise climbing fluency and lead to 
the onset of fatigue. The aim of this article is to 
propose a method to automatically detect and quan¬ 
tify some of the major climbing activities: immobil¬ 
ity, postural regulation, hold exploration, hold change 
and traction. As stated in mm, these activities 
can only be defined by taking into account the activ¬ 
ities of both the limbs and the pelvis. 
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2 Data and protocol 

2.1 State of the art 

Previous studies like those of m and m focused on 
rock climbing and analysed the climbers behaviour. 
This was accomplished by making video recordings of 
the climb and having experts manually perform the 
analysis. This method has several drawbacks, as the 
possibilities for analysis are limited, the results are 
of relatively low accuracy, and the process itself is 
long and tedious. Moreover, a full view of the climb¬ 
ing wall might not be available for video recording in 
outdoor studies without the use of drones or similar 
devices. 

Automatic measures were reported in [16] and [1], 
with force sensors placed inside the holds on the 
climbing walls. Despite the high cost of the exper¬ 
imental devices for long routes, this method is not 
usable outdoors and requires a long set-up for indoor 
walls that are not yet equipped. 

Given the disadvantages of these methods, wire¬ 
less sensors placed on the climber might be a good 
solution, offering easy measurement set-up and quick 
adaptation to the route environment (indoors or out¬ 
doors). In [17], for example, the climber carried a 
single miniature accelerometer that was used to eval¬ 
uate different performance coefficients. However, this 
article did not present an analysis of behaviour or a 
procedure for distinguishing activities and their dis¬ 
tribution along the climb. It also did not assess the 
activities of the different limbs, which is needed to de¬ 
termine the climber state on the climbing wall. This 
article presents a method using multiple inertial mea¬ 
surement units (IMUs) placed on several body sites, 
with each IMU containing an accelerometer, a gyro¬ 
scope and a magnetometer to detect limb and pelvic 
activities based on their acceleration or angular ve¬ 
locity. This step, presented in Section [S] requires 
learning statistical modelling with a labelled set of 
climbs, which is accomplished by manual annotation 
on video recordings of climbing experts. However, 
these videos are no longer needed once the learning 
protocol is completed, and Sect ion |4] presents a proce¬ 
dure for determining full-body activity by combining 
the independent detections of limb activity. 

2.2 Protocol 

Two male climbers of ability 6a on the French Rating 
Scale of Difficulty (F-RSD) [18], which corresponds to 
an intermediate performance level m, undertook an 


easy, top-roped route (grade of 5c on F-RSD) com¬ 
posed of 20 hand holds for a 10m height. The route 
was identifiable by colour and set on an artificial 
indoor climbing wall by two certified route setters 
who ensured that it matched an intermediate level 
of climbing performance. The participants were in¬ 
structed to self-pace their ascent and to climb fluently 
and without falling. The ascents were preceded by 3 
minutes of route preview, as pre-ascent visual inspec¬ 
tion is a key parameter of climbing performance [8]. 
Procedures were explained to the climbers, who then 
gave written informed consent to participate! 0. 

Each climber was considered to be in one the fol¬ 
lowing states at any given time: immobility, postural 
regulation, hold exploration, hold change or traction. 
As stated previously, a single detection of limb activ¬ 
ity is required to describe the full-body state. 

Accelerations and angular velocities were collected 
from the four limbs and pelvis using IMUs located 
on the right and left wrists, right and left feet, and 
pelvis. The IMUs combined a triaxial accelerometer 
(±8G), a triaxial gyroscope (1600°/<s) and a triax¬ 
ial magnetometer (MotionPod, Movea©, Grenoble, 
France) referenced to magnetic North, sampled at 
lOOHz. Wireless transmissions to a controller enabled 
recording with MotionDevTool software (Movea©, 
Grenoble, France). A wearable device is required to 
measure climbing activities on a 10m-high climbing 
wall. 

2.3 Recording and preprocessing 

The acceleration of each sensor was determined from 
the recorded signals. These data were used to syn¬ 
chronise the video recording of the climb with the 
IMU signals in the learning phase of the detection, 
as well as to detect activity. Therefore, this method 
had to be used even on unlabelled sets of climbing. 

Although the sensors directly record the accelera¬ 
tion in the sensor frame, the recording cannot be used 
directly as proper acceleration because of the grav¬ 
ity component. The norm of this component is well- 
known (9.81m/5^), but it cannot be removed from 
the sensor frame without knowing the orientation of 
the sensor in the ground reference frame. 

Let as be the recorded acceleration in the sensor 
frame. By denoting R the rotation matrix describing 
the sensor frame in the Earth reference frame (mag¬ 
netic North, West and vertical up direction), the ac- 

^The protocol was approved by the local University ethics 
committee and followed the declaration of Helsinki. 
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Figure 1: Example of the frame difference between 
the ground frame (red), where the gravity is known, 
i.e can be removed, and the sensor (grey box) frame 
(blue), where the gravity components are unknown 
and cannot be removed from the recorded accelera¬ 
tion (sum of the green vectors). 

celeration a in the Earth reference is then defined as 
a = Rag. Once a is obtained, the gravity component 
can easily be removed (see Eigure[T]). 

To determine i?, a complementary filter based al¬ 
gorithm is used mm, based on the three sensor 
information sources (i.e. accelerometer, gyroscope 
and magnetometer). The gyroscope measures pre¬ 
cise angular changes over very short time durations 
but cannot be used to track the angle changes by in¬ 
tegration due to drift. The accelerometer provides 
absolute, albeit noisy, measurements of acceleration. 
By combining the two sensor information sources it 
was possible to reduce the drift of the gyroscope for 
sensor orientation tracking. When magnetometer in¬ 
formation was added, it was possible to compute the 
sensor orientation respect to the fixed frame of Earth 
reference. 

Eigure [2] provides an example of the recorded norm 
of the processed acceleration signal. 

Based on the processed acceleration and the angu¬ 
lar velocity, we automatically detected the limb mo¬ 
tion using the cusum [22] method. 

3 Activity detection 

Activity was detected from each sensor indepen¬ 
dently. As this method requires a learning phase, 
this last is also described in detail. Once the learning 



Eigure 2: Example of the evolution in the norm of a 
recorded acceleration after removing the gravity com¬ 
ponent. The sensor was attached to the climbers right 
foot. The acceleration is measured in mj. 

phase is completed, the paragraph 13.11 can directly be 
used. 

3.1 Cusum-based detection 

The cusum algorithm is often used to determine a 
change point in a time series of independent random 
variables based on statistical models. In this case, we 
assume that a limb is either immobile (state called 
i^o) or mobile (in motion) (state R\) at a given time. 
It is further assumed that these states are exhaustive 
and exclusive, i.e. for each sample, the limb is in 
one of these states and only one. The idea is thus to 
estimate the state of the limb based on the recorded 
signals. Let Xt be the considered signal. In our case, 
it will be the norm of either the acceleration or the 
angular velocity. 

The main idea is to assume that Xt is a random 
variable sampled from a distribution fixed by the 
state of the limb. In other words, if the limb is in 
state iLo (respectively iLi), then Xt ^ p{.\Ho) (re¬ 
spectively Xt ^ If p{.\Ho) and p{.\Hi) are 

known, a likelihood ratio can be computed for a given 
t (we directly consider t as a discrete variable, due 
to the sampling process) to estimate the distribution 
from which t was sampled 

It = log {p{xt\Hi)) - log {p{xt\Ho)). 

The sign of If provides an estimation of the state 
of the limb at time t: iLi for positive and Hq for 
negative. 

It is assumed that the state changing periods are 
much longer than the sampling time and can there¬ 
fore form a cumulative sum to increase the detection 


3 





















performance. Let 5'f be the cumulative sum of the 
log likelihood ratio 

= ( 1 ) 

k<t 

The propensity of Sf to be monotonous indicates the 
state the limb should be assumed to be in. A change 
in monotony implies a change in the state. An algo¬ 
rithm looking directly at a change in monotony would 
be subject to many false detections. Instead, the use 
of positive thresholds Aq and Ai helps to reduce false 
alarms. 

For example, given state iLo at t = 0, state Hi is 
detected when 

5'f > min{Sg\s < t) Ai. 

Similarly, to detect Hq while being in state iLi, a 
change occurs when 

S'f < max{Sg\s < t) — Aq. 

When a change point is detected, the process starts 
again by taking the detection time as the new time 
origin and starting the cumulative sum again from 
this point. 

Although thresholds can be chosen to be equal, we 
consider a more general framework here by taking 
different values. These thresholds can influence the 
false positive detection rate and therefore should be 
chosen according to a given performance measure or 
some prior model of detection. 

Thresholds as well as the distributions p{.\Ho) and 
p{.\Hi) are not known in advance in this case, which 
is why a learning step is required. A labelled set 
is used to estimate the distributions and thresholds 
based on manual annotation, described in the next 
section. 

3.2 Construction of the labelled set 

The climbs were video recorded in their entirety, and 
experienced climbers manually annotated three dif¬ 
ferent climbs by two different climbers. They indi¬ 
cated for each frame of the video the state of each 
limb. 

Because the camera and sensors were not synchro¬ 
nised, the delay between the frame-based manual an¬ 
notations and the acceleration had to be estimated. 
The videos were recorded using a fixed camera facing 
the wall, with a red light attached to the climbers 
pelvis. The position of the red light on the image 


therefore gave the position of the pelvis on the wall, 
up to some correction. A classical Kalman filter was 
used to track the red light in the frame, and an 
adaptive filter was required to counterbalance sim¬ 
ilar colours in the surrounding environment (in this 
case, the presence of televisions in the recorded pic¬ 
ture). Once the red-light position on the image was 
obtained, lens distortion had to be corrected, fol¬ 
lowed by parallax correction. An example of auto¬ 
matic tracking after correction is presented in Figure 

m 

Based on the obtained trajectory, an approximate 
acceleration of the pelvis was determined. Using a 
maximum correlation measure with the sensor-based 
lateral and vertical accelerations of the pelvis, the 
delay between each signal was estimated. Therefore, 
the manual annotation (based on the video) and the 
recorded signals (based on the sensors) could be syn¬ 
chronised. An example of correlation is presented in 
Figure [H 

An example of the synchronised annotation and 
signal is presented in Figure [H Based on these an¬ 
notations, a model was determined for each state. In 
this example, it appears clearly that the high values 
of the accelerations match the Hi hypothesis (mobil¬ 
ity). These three annotated climbs, along with the 
recorded IMU signals, will be used as a labelled set 
for the learning phase of activity detection. 

3.3 Learning protocol 

For now, we consider that Xt G is either the norm 
of the acceleration or the norm of the angular veloc¬ 
ity. Using the manual annotations, an example of the 
histogram of the acceleration norm for each hypoth¬ 
esis Hd and Hi is presented in Figure [H 

Instead of considering general distributions for 
p{.\Hi)^ i = 0,1, parametric distributions are con¬ 
sidered. A f^st is performed for each sensor and 
each climb and the results are presented in Table [TJ 
The values presented in Table [T] are averages of the 
p-values for the three annotated climbs. Table [T] com¬ 
pares the fit between the norm of the acceleration and 
its squared value to the Gamma distribution, the ex¬ 
ponential distribution (which seems to fit the sam¬ 
ples in the HO hypothesis), and the distribution 
with three degrees of freedom (corresponding, for the 
squared norm, to a model where each component of 
the signal is sampled from a Gaussian). It indicates 
that the Gamma distribution-based model seems a 
good choice to describe the signals. 
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Figure 3: Example of automatic tracking of the 
climber based on video footage. The trajectory dur¬ 
ing the climb is shown in white. The background 
image is the last image from the video, therefore con¬ 
taining the last tracked position. It is also apparent 
that the red light can be hidden, for example, due to 
substantial body rotation so that the light no longer 
faces the camera. On this image, the lens distortion 
and the parallax were corrected. 



Figure 4: Example of the correlation between the sen¬ 
sor acceleration and the video tracking-based accel¬ 
eration. In this case, the delay maximising the corre¬ 
lation is around 14.75. 



Figure 5: Comparison between the histogram of the 
acceleration (solid line) and the fitting Gamma dis¬ 
tribution (dotted line). For each state, only the cor¬ 
responding (based on the annotations from Figure [6j) 
samples are considered. The fitting Gamma distribu¬ 
tion is trying to fit the histogram and is obtained via 
a maximum likelihood estimation. 















































Acceleration 

Ang. velocity 


norm 

squared 

norm 

squared 

Gamma HO 

1.0 

0.68 

1.0 

0.93 

Expone HO 

1.0 

0.16 

1.0 

0.53 

Gamma HI 

0.59 

0 

0.93 

0.32 


0 

0.13 

0.28 

0.59 


Table 1: p-values of goodness-of-fit tests for the 
norm and squared norms of the acceleration and an¬ 
gular velocity signals. The Gamma and exponential 
models are tested for state i^o, while Gamma and 
with 3 degrees of freedom models are tested for state 
Hi. 

To be more specific, we consider the Gamma dis¬ 
tributions p{.\Hi) for i = 0,1 for both states given 
by 

where Oi and ki are positive real number and i = 0,1 
represents the state. 

The coefficients Oi and ki are determined by max¬ 
imum likelihood. By considering a second order ap¬ 
proximation of the digamma function T' (/c) /T{k) [23] , 
they are given by 

^ ^ — Sj {sj — 3 )^ + 24:Si 
' ^ 125^ ^ ^ 

and 

0i = Ei[x]/ki, (4) 

with 

Si = log(Ei[x]) - [Ei[log(x)] . 

The term Ei[x] represents the empirical average of 
the values of x when the annotation indicates it is 
in state i. These empirical means are determined by 
considering the concatenation of the signals from the 
labeled set. 

Glearly, these parameters change with the nature 
of the signal Xt (norm of the acceleration or norm of 
the angular velocity). 

Based on the signal Xt, using these Gamma distri¬ 
butions with parameters determined via Equations 
m and the cumulated log likelihood ratio 
can be determined. An example is presented, along 
with the annotations, in Figure [6l 





Figure 6: (Top) Example of the norm of the accelera¬ 
tion for one sensor. (Middle) Manual annotation syn¬ 
chronized with the acceleration signal. (Bottom) Gu- 
mulated loglikelihood defined in Equation ([T]) of 
the acceleration signal using the models constructed 
from the annotation. 


The method presented in Paragraph 13.11 leads to 
the determination of a cumulated log likelihood ratio 
(see Equation O), depending on the given signal. 
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Let iSf be based on the norm of the acceleration and 
be based on the norm of the angular velocity. 

This is due to a lack of proper multivariate Gamma 
model, preventing the use of both signals directly. 
Instead, a basic solution is used here where the cusum 
algorithm is run on St, obtained as a weighted sum 
of and 


St = aS^^^ + (1 - a)Sr^ (5) 


where a G [0,1]. For example, if a = 0 (respectively 
1), then only the angular velocity (respectively accel¬ 
eration) is considered for detection. A comparaison 
of the performances depending on a is presented in 
Section 13.41 It should be noted that although 5'^^^ 
and S^^^ are cumulated log likelihood ratios, St is no 
longer one as the only possible distribution associated 
with such a likelihood would not be unitary. There¬ 
fore, maximising © does not correspond to maximis¬ 
ing a likelihood. The minimisation of St should be 
regarded as a minimum contrast estimation method. 

Running the cusum algorithm with different 
thresholds Xi will clearly lead to different estimates. 
To measure the performance of the detection, the co¬ 
efficient 


TP FP 
~P W 


(6) 


is used, where TP is the number of true positives 
(detecting Hi when it is Pi), P (respectively N) the 
number of elements in Pi (respectively Pq) in the 
manual annotation, and FP the number of false pos¬ 
itives (detecting Hi when it is Pq). This coefficient 
corresponds to the performance measure used in the 
learning protocol as it represents, in a ROC curve, 
twice the distance to the diagonal, indicating a ran¬ 
dom decision (Figure [7|). The thresholds are then 
determined as the ones maximising c. 

A comparison of the recorded signal, the annota¬ 
tion and the (optimal) detection is presented in Fig¬ 
ure [HI This figure also illustrates the difference be¬ 
tween the detection based on other annotations where 
all the parameters are learnt from a distinct labelled 
set and the optimal detection based on the signal us¬ 
ing the annotation of the signal itself to perform the 
detection. This optimal detection is not achiveable 
in practice as it requires the annotation of the con¬ 
sidered climb. 

The next section presents the performance of this 
detection via a cross-validation method. 



Figure 7: Example of a ROC figure, representing the 
true positive rate with respect to the false positive 
rate. Each dot represents an estimation for a given 
set of thresholds. The best set of thresholds max¬ 
imising (|6]) is the one maximising the distance to the 
diagonal. In this example, the norm of the angu¬ 
lar velocity was the signal used for detection and the 
sensor was attached to the left foot. 
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Eigure 8: (Top) Norm of the angular velocity. (Mid¬ 
dle top) Manual annotation. (Middle bottom) De¬ 
tection. (Bottom) Optimal estimation. In this case, 
the sensor was attached to the right hand. Eor better 
readability, the weighted coefficient a = 0 was cho¬ 
sen; therefore, only the angular velocity was used in 
the determination of St- It is notable that the opti¬ 
mal estimation still differs from the annotation. 
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Accel. 

Ang. vel. 

Ace, Ang vel 


score 

opt 

score 

opt 

score 

opt 

L F 

0.79 

0.80 

0.80 

0.81 

0.67 

0.82 

RF 

0.74 

0.80 

0.75 

0.83 

0.64 

0.84 

L H 

0.47 

0.62 

0.53 

0.64 

0.48 

0.68 

RH 

0.42 

0.53 

0.43 

0.60 

0.37 

0.59 

Pelv. 

0.31 

0.38 

0.34 

0.48 

0.11 

0.49 


Table 2: Score and optimal score of the cross- 
validation for a = 0 (Ang. velocity), a = 1 (Accel) 
or the optimal a. The score is only slightly increased 
for the optimal value. 

3.4 Performance and limitations 

A cross-validation method was used to evaluate the 
performances of the learning algorithm. The method 
consists of learning the different parameters {ki^Oi^Xi 
for i = 0,1), concatenating two out of the three anno¬ 
tated climbs, and applying these parameters on the 
third one. The annotation for the third climb makes 
it possible to determine a performance measure via 
the coefficient from ([6|). An optimal coefficient c can 
also be determined by directly learning all the pa¬ 
rameters only using the third climb. This gives an 
idea of the best achievable performance. Then, per¬ 
mutations between the learning and testing climbs 
are made and the average coefficient c is considered 
as the final performance of the algorithm. Table [2] 
presents the results from the cross-validation for all 
the sensors for a = 0,1 and the value maximising the 
score (and therefore, better than the extrema value). 
It appears that the score is roughly similar for the dif¬ 
ferent values of a. However, the optimal value of a 
(different for each sensor) will be used from now on. 
For further applications with non-annotated climbs 
(see Paragraph [T3]), the learning phase is carried out 
on all three annotated climbs. 

The optimal detection did not provide a very high 
performance measure in all cases. This may have had 
several causes: 

• Missing a movement during manual annotation: 
Due to the lack of visibility of the concerned 
limb. 

• Delay or different movement period: As the an¬ 
notation is manual, a delay might occur between 
a movement and its detection by the person an¬ 
notating the video. 

• Sensor is hit during the climb: For example. 


this occurs when the climber claps his hands 
together, creating an acceleration peak of both 
wrist sensors. 

• Defective orientation estimation : As the accel¬ 
eration signal requires the sensor orientation, a 
wrong orientation estimation will directly add 
bias to the acceleration because the gravity com¬ 
ponent will no longer be aligned with the vertical 
(according to the sensor). 

The next section presents how these binary detec¬ 
tions (state Hi OY Hq) from each sensor can be classi¬ 
fied to describe a full-body state and how this is used 
to measure exploration during a climb. 

4 Activity classification 

4.1 Full-body activity 

Based on state detection of the four limbs and pelvis, 
we defined four exclusive states matching the different 
activities of the climber: 

• Immobility: All limbs are immobile and the 
pelvis is immobile. 

• Postural Regulation: All limbs are immobile and 
the pelvis is moving. 

• Hold interaction : At least one limb is moving 
and the pelvis is immobile. 

• Traction : At least one limb is moving and the 
pelvis is moving. 

Immobility is the state when the climber is not 
moving at all. He might be resting due to fatigue or 
looking at the route to determine its climbing path, 
while his limbs remain immobile. 

Postural regulation is the adjustment of the 
climbers centre of mass while his limbs stay on the 
same holds. This might consist of a body rotation to 
be able to catch a hold that would not be reachable 
with the previous body configuration. 

Hold interaction is the movement of a limb while 
maintaining the pelvis (and therefore the global po¬ 
sition of the climber on the wall) immobile. This 
is a change in the hold in use before the next trac¬ 
tion, a change in the position and orientation of 
the hand/foot on an hold for better adapted use of 
the hold, or successive limb movement to determine 
which hold is most appropriate for the next traction. 























In the next section, we present a more detailed classi¬ 
fication to differentiate actual use of a hold from hold 
exploration. 

Traction is the state when the climber is moving 
(generally upward) using at least one limb. Although 
the limb might not be moving as substantially as dur¬ 
ing a hold change, this state is still easily detected and 
its definition seems to fit the climbers actual traction 
phases on the video. 

An example of the successive states for a climb is 
presented in the last panel of Figure [TOl 



4.2 Limb state 

It quickly appears that the state of hold interaction 
covers a wide spectrum of activities. It is not directly 
possible to determine whether the climber is actually 
using a hold or moving a limb towards different holds 
to check whether they are reachable and, if so, how 
to use them (in this case, the limb can remain on the 
same hold but change its orientation). Consequently, 
new states for each limb are considered as sub-states 
of the Hold interaction defined in Section 14.11 These 
sub-states are the following: 

• Immobility: When a limb is detected as being 
immobile. 
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• Use : When a limb is moving during traction. 

• Change: The last movement before traction, or 
the final change in hold (or change in limb ori¬ 
entation on the same hold) before being used. 

• Exploration: All movements except the last one 
before traction. An example is the case when the 
climber is trying several holds before choosing 
the one he will be using for traction. 

A summary of the different states is presented in Fig¬ 
ure E and an example of the full state analysis of a 
climb is presented in Figure flOl 

4.3 Example of application 

This section presents a simple example of application 
based on the previous algorithm: measuring the ratio 
between exploratory and performatory movements. 

As previously noted, this ratio can be used to differ¬ 
entiate skilled and unskilled climbers [3] , which makes 
automatic detection of the ratio very useful. Based 
on the present algorithm. Exploration and Change en¬ 
compass all the exploratory movements for each limb. 


^— Hold iittcra^rl.km 

-J^ExploiAtlDTl I 
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Figure 9: Decision tree from the signals. White rect¬ 
angles are decisions from single sensors and red rect¬ 
angles are multiple sensor decisions. Each decision 
depends on the decisions from other senors. The last 
layer for the limb detection tree depends on the next 
traction detection. 
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Figure 10: Example of classification from a non an- 
noted climb. From top to bottom: full state evolution 
for each limb: right hand, left hand, right foot, left 
foot and full body state evolution during the climb. 

whereas Use reflects only the performatory move¬ 
ments. The results based on a total of 94 climbs 
by three experts and three beginners on a 10m-high 
climbing route are presented in Figure [TTJ A distinc¬ 
tion between experts and beginners clearly emerges 
based on the ratio between these quantities. 

Like previously stated, it has been shown [3] that 
this ratio can be used to differentiate skilled and un¬ 
skilled climbers. There is therefore an interest in au¬ 
tomatically detecting this ratio. Based on the present 
algorithm, the number of exploratory movements will 
gather, for each limb, the number of Exploration and 
Change while the number of performatory movement 
only counts the Use activity periods. Results based 
on a total of 94 climbs realized by 3 experts and 3 be¬ 
ginners on a 10 meters high climbing route are pre¬ 
sented in Figure [TTJ A distinction between experts 
and beginners clearly appears considering the ratio 
between these quantities 

It should be noted that some of the values from this 
figure seem rather high for a lOm-high climbing route. 
This is partly due to the computation of the sensor 
orientation, which is still somewhat inexact. If the 
orientation is not properly determined, the computed 
acceleration contains residuals from the gravity com¬ 
ponent, inducing a mobile phase detection further on 
and misleading the counting process. One possibil¬ 
ity to eliminate this issue might be to only consider 
the angular velocity value, as the performances do 
not differ significantly between angular velocity and 


Figure 11: Comparison between the number of holds 
touched by the hands (exploratory movement) and 
the number of holds used (performatory movement) 
during a climb. Results for the feet are quite simi¬ 
lar. A classification clearly appears based on the ratio 
between these quantities. 

acceleration use. Another factor might be individual 
differences between the climbers from the labelled set 
used for the learning protocol and the climbers used 
in this application. To prevent this individual de¬ 
pendent measure, the learning phase can be accom¬ 
plished using a dedicated climber recording and the 
learnt parameters only for this specific climber. 

5 Conclusion 

This article presents a method for the automatic de¬ 
tection and classification of climbers activities based 
on multiple IMUs. From a learning phase requiring 
manual annotations, a statistical model is built for 
the norms of acceleration and angular velocity. This 
model is used in a cusum algorithm to detect a binary 
movement state for each limb with an attached sen¬ 
sor. The concatenation of the states of each sensor is 
used to determine and classify full-body activity. A 
more detailed classification is then used to measure 
exploration during the climb. 

Determining exploratory activity during climbing 
is useful as it provides a measure of skill and learning 
performances. Future works will focus on the use of 
this method in a learning protocol for indoor climb¬ 
ing, measuring the occurrence and distribution of ex¬ 
ploration and immobility in the participants. An¬ 
other study on immobility is planned to determine 
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which body configurations are mainly used during 
learning and how these configurations evolve from 
climb to climb during a learning protocol 
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